Guidelines: The do's, don'ts and don't knows of direct observation of clinical skills in medical education.

IntroductionDirect observation of clinical skills is a key assessment strategy in competency-based medical education. The guidelines presented in this paper synthesize the literature on direct observation of clinical skills. The goal is to provide a practical list of Do's, Don'ts and Don't Knows about direct observation for supervisors who teach learners in the clinical setting and for educational leaders who are responsible for clinical training programs.MethodsWe built consensus through an iterative approach in which each author, based on their medical education and research knowledge and expertise, independently developed a list of Do's, Don'ts, and Don't Knows about direct observation of clinical skills. Lists were compiled, discussed and revised. We then sought and compiled evidence to support each guideline and determine the strength of each guideline.ResultsA final set of 33 Do's, Don'ts and Don't Knows is presented along with a summary of evidence for each guideline. Guidelines focus on two groups: individual supervisors and the educational leaders responsible for clinical training programs. Guidelines address recommendations for how to focus direct observation, select an assessment tool, promote high quality assessments, conduct rater training, and create a learning culture conducive to direct observation.ConclusionsHigh frequency, high quality direct observation of clinical skills can be challenging. These guidelines offer important evidence-based Do's and Don'ts that can help improve the frequency and quality of direct observation. Improving direct observation requires focus not just on individual supervisors and their learners, but also on the organizations and cultures in which they work and train. Additional research to address the Don't Knows can help educators realize the full potential of direct observation in competency-based education

Fostering medical students' lifelong learning skills with a dashboard, coaching and learning planning.

IntroductionTo develop lifelong learning skills, students need feedback, access to performance data, and coaching. A new medical curriculum incorporated infrastructural supports based on self-regulated learning theory and the Master Adaptive Learner framework to engage students in reflection and learning planning. This study examines students' experience with a performance dashboard, longitudinal coaching, and structured time for goal-setting.MethodsFocus groups with first-year medical students explored performance dashboard usage, coaching and learning planning. We analyzed findings using thematic analysis. Results informed development of a 29-item survey rated strongly disagree (1) to strongly agree (5) to investigate experience with the dashboard, coaching and learning goals program. The survey was distributed to one first-year medical student class. We performed descriptive statistics and factor analysis.ResultsIn three focus groups with 21 participants, students endorsed using the dashboard to access performance information but had trouble interpreting and integrating information. They valued coaches as sources of advice but varied in their perceptions of the value of discussing learning planning. Of 152 students, 114 (75%) completed the survey. Exploratory factor analysis yielded 5 factors explaining 57% of the variance: learning goals development (α = 0.88; mean 3.25 (standard deviation 0.91)), dashboard usage (α = 0.82; 3.36 (0.64)), coaching (α = 0.71; 3.72 (0.64)), employment of learning strategies (α = 0.81; 3.67 (0.79)), and reflection (α = 0.63; 3.68 (0.64)).DiscussionThe student performance dashboard provides efficient feedback access, yet students' use of this information to guide learning is variable. These results can inform other programs seeking to foster lifelong learning skills

Medical Students’ Use of the Stages of Change Model in Tobacco Cessation Counseling

BACKGROUND: Many medical schools have incorporated the Stages of Change Model into their curricula with specific application to tobacco cessation. OBJECTIVE: This study examined the extent to which medical students were prepared to provide stage-based interventions to treat nicotine dependence. DESIGN: Using a quasi-experimental design, medical students’ counseling interactions were evaluated with a standardized patient portraying a smoker in either the precontemplation or preparation stage of change. PARTICIPANTS: Participants were 147 third-year medical students at the University of California, San Francisco. MEASUREMENTS: Checklists completed by standardized patients evaluated students’ clinical performance. Surveys administered before and after the encounters assessed students’ knowledge, attitudes, confidence and previous experience with treating smoking. RESULTS: Most students asked about tobacco use (89%), advised patients of the health benefits of quitting (74%), and assessed the patient’s readiness to quit (76%). The students were more likely to prescribe medications and offer referrals to patients in the preparation than in the precontemplation stage of change (P < 0.001); however, many students had difficulty identifying patients ready to quit, and few encouraged patients to set a quit date or arranged follow-up to assess progress. Students’ tobacco-related knowledge, but not their attitudes, confidence, or previous experience predicted their clinical performance. CONCLUSIONS: The findings indicated evidence of students tailoring their counseling strategies to the patients’ stage of change; however, they still could do more to assist their patients in quitting. Additional training and integration of cessation counseling into clinical rotations are needed

An innovative quality improvement curriculum for third-year medical students

Background: Competence in quality improvement (QI) is a priority for medical students. We describe a self-directed QI skills curriculum for medical students in a 1-year longitudinal integrated third-year clerkship: an ideal context to learn and practice QI. Methods: Two groups of four students identified a quality gap, described existing efforts to address the gap, made quantifying measures, and proposed a QI intervention. The program was assessed with knowledge and attitude surveys and a validated tool for rating trainee QI proposals. Reaction to the curriculum was assessed by survey and focus group. Results: Knowledge of QI concepts did not improve (mean knowledge score&#x00B1;SD): pre: 5.9&#x00B1;1.5 vs. post: 6.6&#x00B1;1.3, p=0.20. There were significant improvements in attitudes (mean topic attitude score&#x00B1;SD) toward the value of QI (pre: 9.9&#x00B1;1.8 vs. post: 12.6&#x00B1;1.9, p=0.03) and confidence in QI skills (pre: 13.4&#x00B1;2.8 vs. post: 16.1&#x00B1;3.0, p=0.05). Proposals lacked sufficient analysis of interventions and evaluation plans. Reaction was mixed, including appreciation for the experience and frustration with finding appropriate mentorship. Conclusion: Clinical-year students were able to conduct a self-directed QI project. Lack of improvement in QI knowledge suggests that self-directed learning in this domain may be insufficient without targeted didactics. Higher order skills such as developing measurement plans would benefit from explicit instruction and mentorship. Lessons from this experience will allow educators to better target QI curricula to medical students in the clinical years

Effectiveness of physiotherapy exercise following hip arthroplasty for osteoarthritis: a systematic review of clinical trials

Background: Physiotherapy has long been a routine component of patient rehabilitation following hip joint replacement. The purpose of this systematic review was to evaluate the effectiveness of physiotherapy exercise after discharge from hospital on function, walking, range of motion, quality of life and muscle strength, for osteoarthritic patients following elective primary total hip arthroplasty. Methods: Design: Systematic review, using the Cochrane Collaboration Handbook for Systematic Reviews of Interventions and the Quorom Statement. Database searches: AMED, CINAHL, EMBASE, KingsFund, MEDLINE, Cochrane library (Cochrane reviews, Cochrane Central Register of Controlled Trials, DARE), PEDro, The Department of Health National Research Register. Handsearches: Physiotherapy, Physical Therapy, Journal of Bone and Joint Surgery (Britain) Conference Proceedings. No language restrictions were applied. Selection: Trials comparing physiotherapy exercise versus usual/standard care, or comparing two types of relevant exercise physiotherapy, following discharge from hospital after elective primary total hip replacement for osteoarthritis were reviewed. Outcomes: Functional activities of daily living, walking, quality of life, muscle strength and range of hip joint motion. Trial quality was extensively evaluated. Narrative synthesis plus meta-analytic summaries were performed to summarise the data. Results: 8 trials were identified. Trial quality was mixed. Generally poor trial quality, quantity and diversity prevented explanatory meta-analyses. The results were synthesised and meta-analytic summaries were used where possible to provide a formal summary of results. Results indicate that physiotherapy exercise after discharge following total hip replacement has the potential to benefit patients. Conclusion: Insufficient evidence exists to establish the effectiveness of physiotherapy exercise following primary hip replacement for osteoarthritis. Further well designed trials are required to determine the value of post discharge exercise following this increasingly common surgical procedure

Promoting inclusivity in health professions education publishing

A taskforce established by Medical Education asks readers to engage in discussion about how the journal and field can do better to ensure that health professional education publishing is inclusive of diverse knowledge and perspectives.https://onlinelibrary.wiley.com/journal/13652923hj2023School of Health Systems and Public Health (SHSPH

Assessment of Medical Students’ Shared Decision-Making in Standardized Patient Encounters

BackgroundShared decision-making, in which physicians and patients openly explore beliefs, exchange information, and reach explicit closure, may represent optimal physician-patient communication. There are currently no universally accepted methods to assess medical students' competence in shared decision-making.ObjectiveTo characterize medical students' shared decision-making with standardized patients (SPs) and determine if students' use of shared decision-making correlates with SP ratings of their communication.DesignRetrospective study of medical students' performance with four SPs.ParticipantsSixty fourth-year medical students.MeasurementsObjective blinded coding of shared decision-making quantified as decision moments (exploration/articulation of perspective, information sharing, explicit closure for a particular decision); SP scoring of communication skills using a validated checklist.ResultsOf 779 decision moments generated in 240 encounters, 312 (40%) met criteria for shared decision-making. All students engaged in shared decision-making in at least two of the four cases, although in two cases 5% and 12% of students engaged in no shared decision-making. The most commonly discussed decision moment topics were medications (n = 98, 31%), follow-up visits (71, 23%), and diagnostic testing (44, 14%). Correlations between the number of decision moments in a case and students' communication scores were low (rho = 0.07 to 0.37).ConclusionsAlthough all students engaged in some shared decision-making, particularly regarding medical interventions, there was no correlation between shared decision-making and overall communication competence rated by the SPs. These findings suggest that SP ratings of students' communication skill cannot be used to infer students' use of shared decision-making. Tools to determine students' skill in shared decision-making are needed

Faculty verbal evaluations reveal strategies used to promote medical student performance

Background: Preceptors rarely follow medical students&#x2019; developing clinical performance over time and across disciplines. This study analyzes preceptors&#x2019; descriptions of longitudinal integrated clerkship (LIC) students&#x2019; clinical development and their identification of strategies to guide students&#x2019; progress. Methods: We used a common evaluation framework, reporter-interpreter-manager-educator, to guide multidisciplinary LIC preceptors&#x2019; discussions of students&#x2019; progress. We conducted thematic analysis of transcripts from preceptors&#x2019; (seven longitudinal ambulatory preceptors per student) quarterly group discussions of 15 students&#x2019; performance over one year. Results: All students&#x2019; clinical development progressed, although most experienced obstacles. Lack of structure in the history and physical exam commonly obstructed progression. Preceptors used templates for data gathering, and modeling or experiences in the inpatient setting to provide time and solidify structure. To advance students&#x2019; knowledge acquisition, many preceptors identified focused learning topics with their students; to promote application of knowledge, preceptors used reasoning strategies to teach the steps involved in synthesizing clinical data. Preceptors shared accountability for helping students advance as the LIC allowed them to follow students&#x2019; response to teaching strategies. Discussion: These results depict preceptors&#x2019; perceptions of LIC students&#x2019; developmental continuum and illustrate how multidisciplinary preceptors can use a common evaluation framework to identify strategies to improve performance and follow students&#x2019; performance longitudinally

Which Internal Medicine Clerkship Characteristics Are Associated With Students’ Performance on the NBME Medicine Subject Exam? A Multi-Institutional Analysis

Purpose To identify which internal medicine clerkship characteristics may relate to NBME Medicine Subject Examination scores, given the growing trend toward earlier clerkship start dates. Method The authors used linear mixed effects models (univariable and multivariable) to determine associations between medicine exam performance and clerkship characteristics (longitudinal status, clerkship length, academic start month, ambulatory clinical experience, presence of a study day, involvement in a combined clerkship, preclinical curriculum type, medicine exam timing). Additional covariates included number of NBME clinical subject exams used, number of didactic hours, use of a criterion score for passing the medicine exam, whether medicine exam performance was used to designate clerkship honors, and United States Medical Licensing Examination Step 1 performance. The sample included 24,542 examinees from 62 medical schools spanning 3 academic years (2011–2014). Results The multivariable analysis found no significant association between clerkship length and medicine exam performance (all pairwise P > .05). However, a small number of examinees beginning their academic term in January scored marginally lower than those starting in July (P < .001). Conversely, examinees scored higher on the medicine exam later in the academic year (all pairwise P < .001). Examinees from schools that used a criterion score for passing the medicine exam also scored higher than those at schools that did not (P < .05). Step 1 performance remained positively associated with medicine exam performance even after controlling for all other variables in the model (P < .001). Conclusions In this sample, the authors found no association between many clerkship variables and medicine exam performance. Instead, Step 1 performance was the most powerful predictor of medicine exam performance. These findings suggest that medicine exam performance reflects the overall medical knowledge students accrue during their education rather than any specific internal medicine clerkship characteristics